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Abstract. We study orbits and reachable sets of generic couples of Hamiltonians H\,H2 on 
a symplectic manifold A''. We prove that, C'^-generically for k large enough, orbits coincide 
. . . with the whole of N , and that the same is true for reachable sets when N is compact. 

CO , Our results are stated in terms of a strong form of genericity which makes use of the notion 

of rectifiable subsets of positive codimension in Banach or Frechet spaces. 
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■ All considered manifolds are separable, finite dimensional, smooth, connected and without 

boundary, unless otherwise stated. 



O ■ 1. Introduction 

m 

In this paper we consider the switched system associated to a generic couple of Hamiltonians 
Hi,H2 on a symplectic manifold N. Our focus is to prove that orbits and reachable sets of 
such a system are generically the whole of N. Our work is in the same spirit of a paper of 
Lobry [8] who proved that, for a C'^-generic couple of vector fields on a manifold M and for k 
■ large enough, orbits are the whole of M. 

We will come back later to our notion of genericity, which is given in terms of rectifiable 
subsets of positive codimension in a Banach or Frechet space and which is stronger than the 
usual one based on the Baire Category Theorem. Let us now quickly recall the definitions of 
orbit and reachable set. 

Let us denote by {4>\j-^}t and Hamiltonian (local) flows of Hi and H2 respectively. 

We assume that Hi and H2 are at least C^. The orbit Ohi,H2{z) ^ -/V of a point z & N through 
the switched system associated to Hi and H2 is obtained by applying to z the groufO generated 
by the two flows. More explicitly, 

OmMz) = o---o4'h^ i^) ■h,---,in G {l,2},ti,...,t„ GlR,n > l| . 



* Universite Paris-Dauphine & Universite Paris-Sud. 

^This should be more properly called a pseudogroup, since the flows may not be complete. 
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The reachable set of z, denoted by Oj^^ fj^{z), represents instead the "future" of z, and is 
obtained by applying to z the (pseudo-)semigroup generated by {(p^jj-^}t>o and {(l)\j^}t>o- More 
exphcitly, 

^H,,H2^^) = {(t>%^o---o4>X^{z):ii,...,in G {l,2},ti,...,t„ > 0,n > 1} . 

By taking < in the expression above one gets the analogous definition for the 

negative reachable set 0^_^ H2^^^^ "past" of z. 

When interested in orbits, we say that we are in the time-unoriented case. We say that we 
are in the time- oriented case when we are interested in reachable sets. 

The main result of this paper is that for a C'^'-generic couple Hi , H2 and for k large enough 
orbits are the whole of N , and the same is true for reachable sets provided that the manifold 

is compact. In fact, we prove something more accurate than C'^-genericity of couples: in 
a first respect, we adopt the notion of rectifiable set of positive codimension in Banach or 
Prechet spaces, which is a stronger notior0 than genericity in the sense of Baire: indeed, such 
a rectifiable set is always Baire-meager whereas the viceversa is not always true (see [3] for 
a detailed study; the basic facts and definitions are recalled in Section 12. 2p . In a second 
respect, we make perturbations just in H2 leaving Hi fixed (apart from a small subset of 
highly degenerate Hi, see Assumption [1] below) . 

Let us set dimA^ = 2d. Recall that, for each k ^ N, the space C^{N) of C'^-real functions 
on is a Banach space when N is compact, and a Frechet space otherwise. Our main results 
are as follows: 

Main theorem 1 (Time-unoriented case). Let Hi € C^'^~^^{N) satisfy the non- degeneracy 
assumptionUl below. Let k > Ad. Then, the set 

[h2 G C\N) : Oh.Mz) = iVVz G iv} 

has rectifiable complementary of codimension > 1 in C^{N). In particular, it is C'' -generic. 

Main theorem 2 (Time-oriented case). Assume that N is compact. Let Hi and k be as 
before. Then, the set 

{h2 e cHn) : 0+^ H,i^) = N \/ z e n} 
has rectifiable complementary of codimension > 1 in C^{N), and in particular it is C^-generic. 

The two results above are proved in Section [3] (Theorems 1111 and I12p . They extend quite 
naturally to time-dependent Hamiltonians as well, this is the content of the last Section [H 

The proofs make fundamentally use of three ingredients, namely the Rashevski-Chow The- 
orem, the Thom transversality Theorem and the Hamiltonian flow-box Theorem. The exact 
statements serving our purposes will be given in Section [2l 

The Rashevski-Chow Theorem, as it is well-known, makes a link between the Lie algebra 
spanned by two vector fields at a point and the orbit or reachable set of that point. The 
part concerning reachable sets is more precisely called Krener Theorem. In Section 12.11 we 
recall some local and global versions of these theorems. In the global time-oriented version we 
will make the additional assumption that the flows of the considered vector fields have non- 
wandering dynamics. Under the assumptions of Krener Theorem, this is a sufficient condition 
for concluding that reachable sets are equal to the whole manifold. On the other hand, every 
Hamiltonian flow on a compact symplectic manifold is non- wandering by Poincare recurrence 
Theorem; this is the reason for the compactness assumption on N in the statement of the Main 
Theorem 2. 

Concerning the Thom Transversality Theorem, we use a refined version of the classical result 
which has been recently proved in [3]. Such a version yields that the set of maps whose jet 
is transverse to a submanifold in a jet space not only is generic, but its complementary is 



It is also stronger than some other notions of translational invariant "smaUness" in infinite-dimensional 
spaces, such as prevalence or Aronszajn-nuUity, see 



GENERIC TRANSITIVITY FOR COUPLES OF HAMILTONIANS 



3 



rectifiable of positive codimension, which, as already mentioned, is a stronger information. We 
recall the result in Section 12.21 along with the notion of rectifiable set of positive codimension 
in Banach (or Frechet) spaces. 

The last ingredient is the Hamiltonian flow-box Theorem, a normal form result which makes 
computation of iterated Lie (or Poisson) brackets handleable. The exact statement is recalled 
in Section [231 

We finish the introduction by stating the non-degeneracy assumption required to Hi in the 
main results above. Let us first give a definition. 

Definition 1. Let S ^ M be a subset of the manifold M . We say that S has codimension c 
in M, and we write codimMS" = c, if 

for a countable family {S^}i of C^-submanifolds of codimension > c in M. 

Note that, according to the above definition, a subset 5 of codimension c is also of codimen- 
sion c' for every c' < c. In fact, in this paper we are interested in estimate the size of certain 
subsets, and only lower bounds (rather than sharp values) for codimension will matter. 

Assumption 1. The Hamiltonian Hi is continuously differentiable and the subset Nq C N 
defined by 

No = {zeN : d,Hi = 0} 

is contained in a countable union Ui^f^N^ of C"^ -submanifolds of N of codimension greater or 
equal than _)_ \ Given such a famil"^ {-^'}/ define the tangent space TNq as 

TNo = [j TNK 

Note that each TN^ is a submanifold of class . According to DefinitionUl we have 

^ dimA^ 
codim atA/q > — h 1 

codimT^TvTA'^o > 2 codim n^o ^ dim + 2. 

The Assumption [T] is generically satisfied, by an immediate application of the classical Thorn 
trans versality Theorem. 

Acknowledgements - I would like to thank my thesis advisor Patrick Bernard for useful 
remarks and suggestions at different stages of this paper. 

2. Notation and preliminaries 

2.1. The Rashevski-Chow Theorem: time-unoriented and time-oriented versions. 

We state here several versions of the Rashevski-Chow theorem for two (non-necessarily Hamil- 
tonian) vector fields. For the proofs we refer to the books [3 [2]. The proofs in these references 
are sometimes given for smooth vector fields, but they hold unchanged in the case, k > 1. 

Let us first establish some notation. Given two vector fields Xi,X2 {k > 1) on a manifold 
M, the orbit Oxi,X2{^) ™d the reachable set Oj^^ X2('^) ^ point z S M are defined as in the 
introduction, with the (local) fiows of Xi and X2 playing the role of the Hamiltonian flows of 
Hi and H2 of the introduction. 

We denote by Lie '^(Xi, X2) the vector space spanned by the vector flelds 

Xi, X2, [Xi^„[Xi^,[...,[Xi^_,,XiJ,...]]], l<m<k, io,ii,...,ime{l,2}. 



■^We will always assume that, given Hi as above, the family {A^'ji has been chosen once for all. Such a 
choice will never play any role. 
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where [•,•] denotes the usual bracket of vector fields. We also denote by LieJ^(Xi,X2) the 
vector space obtained by bracketing just with Xi, i.e. the span of the k + 2 vector fields 

Xi, X2, [Xi,[Xi,[...,[Xi,X2]...]]], l<m<k. 

' V ' 

m times 

We obviously have 

LieJ(Xi,X2) C Ue^{Xi,X2). 
Evaluating these vector spaces at a point z G M yields a vector subspace of T^M: we will use 
the notation 

Lie^(Xi,X2)(z), Lie ^-(^1,^2) (2) 
to denote these vector subspaces. 

For two Hamiltonians Hi,H2 defined on a symplectic manifold (A^, uj), let us recall the basic 
identity 

^{Hi,H2} = [Xhi,Xh2] 

where {•, •} is the usual Poisson bracket of functions and Xhi , Xh2 ^tre the Hamiltonian vector 
fields of Hi, H2 defined by the usual formula, valid for any function H, 

LXjjUJ = dH. 

In the next sections we will tacitly use the following immediate consequence of the formulas 
above and of the non-degeneracy of the symplectic form: for each z & N, 

Ue'i{XH„XH2){z)=T,N 

^ SpanT;N{d,Hud,H2,d,{Hi,H2}, ... ,4 {^1, {^1, {• • • , {^1,^2} • • • }}}} = T:N. 

k times 

and of course in this case we also have hie^{XH-^^, Xh2){z) = T^N. 

The part (ii) of the following statement is also known as Krener's Theorem. 

Theorem 2 (Local Rashevski-Chow Theorem). Let Xi,X2 be two vector fields {k > 1) on 
the manifold M . Let z € M . 

(i) (time-unoriented case) If Lie ^^^{Xi, X2)iz) = TzM, then z is contained in the interior 
of its orbit Oxi,X2iz)-' 

z € intOxi.Xal^)- 

(ii) (time- oriented case) If Lie^~^{Xi, X2){z) = T^M, then z is contained in the closure 
of the interior of its positive reachable set X2^^)' '^^ ^^^^ '^^ closure of the 
interior of its negative reachable set (z) ; 

z G cl int Oj^^ (z) n cl int O]^^ {z). 

We are now going to state the global counterpart to the previous theorem. In the time- 
oriented case we shall make the additional assumption that Xi and X2 are complete vector 
fields and that all points of M are non- wandering for both Xi and X2. Let us recall the precise 
definition. 

Definition 3. Let X be a complete vector field on the manifold M with flow {^jclteK- ^ 
point z ^ M is said to be non-wandering for X if for every neighborhood U of z and every 
t > there exists t' > t such that 

The set of non-wandering points is closed. Note that a point is non-wandering for X if and 
only if it is non-wandering for —X. Note also that if the flow of X preserve a measure of 
full support and if M is compact then each point is non-wandering for X, by the Poincare 
Recurrence Theorem. This is the case for an Hamiltonian vector field on a compact symplectic 
manifold. 

Theorem 4. Let Xi,X2 be two vector fields {k > 1) on the manifold M. 
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(i) (time-unoriented case) If every z ^ M satisfies 
then 

(a) (time- oriented case) Assume that Xi and X2 are complete and that all points of AI 
are non- wandering for both Xi and X2. If 

(2.1) z ^dmiO\^x2^z)r\dmiOx^x^{z) ^zeM 

then 

0\,,x^^) = M and 0^^^x^{z) = M ^ z e M. 

Proof. The part (i) is an immediate consequence of the connectedness of M. The part (ii) is 
a consequence of the Orbit Theorem (see [5] or [7]), and of Corohary 8.1 and Proposition 8.2 
in [2] as we now quickly recall. Indeed, from the Orbit Theorem and the fact that Oxi,X2iz) 
has non-empty interior (due to assumption ()2.ip ). we get that Oxi,X2{z) is an open subset of 
M for every z. By the part (i) of Theorem [J] we deduce 

Ox,,X2{z) = M yz£M. 

From Proposition 8.2 in [2] and the non-wandering assumptior0 on Xi and X2 we have 

Oxi,X2(^) CclO+ _^^(z) VzGM. 

Putting together the two above relations yields 

M = clO^^^^^{z) yzeM. 

The conclusion now follows by Corollary 8.1 in [2]. □ 

Note that Proposition 8.2 and Corollary 8.1 in [2] are therein stated under the assumption 
that Lie {Xi, X2){z) = TzM for every z € M, but the proofs hold unchanged under the weaker 
assumption ()2.ip . We will need this slightly more general formulation in the sequel. 

Remark 5. We will use in the sequel the following basic fact: given two vector fields 
Xi,X2 on M and z € M, we have 

z G mtOx,,X2iz) ^ int 0x^X2(2) + 0. 

Indeed, let us suppose that the orbit Oxi,X2{z) non-empty interior and let us prove that 
it is open. By changing the point z if necessary, we can suppose that z belongs to the interior 
of Oxi,X2{z)- Let now z' be another point of Oxi,X2{z)- We want to prove that z' belongs to 
the interior of Oxi,X2{'^) as well. By definition of orbit, there exists (j) = 4'x- ° ' ' ' ° (Px, for 
some A; G N, ii, . . . , tfc G M, ii, . . . , ifc € {1, 2}, such that 

z G Domcj) and (j){z) = z'. 

Since Dome/) is open and z G int Oxi,X2 (-2); the set Domcj) fi Oxi,X2iz) is a neighborhood of 
z. Since ^ is a local diffeomorphism, the set (p(Dom(j) Oxi,X2iz)) is a neighborhood of z' 
contained in Oxi,X2{z). This proves that z' G mtOxi,X2{z)- 



In [2] the terminology 'Poisson stable' rather than 'non-wandering' is used. 
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2.2. The Thorn TransversaUty Theorem. Rectifiable sets of positive codimension. 

In this section we recall from [3] the notion of rectifiable set of positive codimension in Banach 
and Frechet spaces. It is quite clear from the definitions below that such a set is automatically 
Baire-meager (i.e. it is contained in a countable union of closed sets with empty interior, or, 
equivalently, its complementary is generic), but the viceversa is not true in general. In this 
sense, the notion of rectifiable set of positive codimension is a stronger notion of "smallness" 
than the one of having generic complementary. 

Let us first give the definition for Banach spaces. We shall present later the extension to 
Prechet spaces. 

Definition 6. The subset A in the Banach space F is a Lipschitz graph of codimension c if 

there exists a splitting F = E ® G, with dim G = c and a Lipschitz map g : E — > G such that 

AC {x + g{x),x e E}. 

A subset A F is rectifiable of codimension c (zN if it is a countable union A = U„(/9„(^„) 
where 

• ifn '■ Un — > F is a Fredholm map of index in defined on an open subset Un in a 
separable Banach space Fn- 

• An ^ Un is a Lipschitz graph of codimension c + in in Fn- 

Finally, a subset A F is rectifiable of positive codimension if it is rectifiable of codimension 
c € N for some c > 1. 

In this paper, the Banach spaces under consideration will mostly be the spaces C^{M), k £ N, 
of real functions of class C'^ on a compact manifold M. 

We shall occasionally consider the case of compact manifolds with boundary. More precisely, 
if M is any such manifold, we will consider the space C^{M) defined as 

C^{M) = |/: M — ;> M : / is of class in M \ dM, f is continuous up to the boundary and 

all partial derivatives of / of order < k extend by continuity to the boundary| 

The space C^{M) is a Banach space when it is endowed with the norm 
(2.2) 11/11^, = max sup \daf{x)\ 

0<\a\<k rc(zM\dM 

the maximum being taken over all multi-indexes a = {ai, . . . ,am) G N"^ of length < k. Here 
m is the dimension of M. For a function / € C^{M), we will regard its fc-jet j'^f as a function 
from M \ dM to J*^(M \ dM, R). 

We will also consider the space C^{M) when M is a non-compact manifold without boundary. 
In this case G^{M) is no more a Banach space, it is however a Frechet space in the usual way, 

i.e. the Frechet topology is given by the family of seminorms ||[ • ||cfc(/^,j)| , where Kn is 

any increasing sequence of compact sets exhausting M and || • is defined as in ()2.2p . 

In fact it is not restrictive to assume that each Kn is a smooth manifold with boundary. 

The definition of rectifiable subset of positive codimension extends to Frechet spaces as 
follows (cf. [31 Section 3], where a different terminology was used: we call 'rectifiable' here 
what was called 'countably rectifiable' there): 

Definition 7. The subset A of the Frechet space F is rectifiable of codimension c if it is 
a countable union A = U„j4„ where each An satisfies: there exists a Banach space Bn and 
a continuous linear map Pn - F ^ Bn with dense range such that Pn(An) is rectifiable of 
codimension c in Bn- 



A Fredholm map of index i between separable Banach spaces is a map such that the differential is 
Fredholm of index i at every point (recall that the index is locally constant). 
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Let us point out from [3, Prop. 16] the following useful compatibility property among the 
spaces C^{M) with respect to different values of k. 

Proposition 8. Let M he a manifold. If A CI C^{M) is rectifiable of codimension c, and 
k' > k, then A n (M) is rectifiable of codimension c in (M). 

The next theorem can be seen as a finer version of the "avoiding case" of the classical Thom 
transversality Theorem in jet spaces. 

Theorem 9. Let M be a manifold, and W C j'^(A/, M) a -submanifold such that 

codim W > dim M + 1 . 

Then, for every r > 1 the set 

{/ G C'=+^(M) : ff{M) n / 0} 

is rectifiable of codimension equal to codim — diniAf > 1 in C^~^'^{M). 

Proof. Let B = {z (zW^ : \z\ < 1} be the open unit disc in R"', and let W he a.C^ submanifold 
of J^{B,M) with codim > d + 1. In [U Prop. 7] it is proved that for every r > 1 the set 

is rectifiable of codimension equal to codim — d in the Banach space C^~^^{B) defined 
according to ()2.2p . 

The proof given in actually yields, with essentially no modifications, the following more 
general result: if M is a compact manifold with or without boundary, and Vl^ is a subman- 
ifold of J''{M \ dM,R) with codim W > dimM + 1, then for every r > 1 the set 

(2.3) {/eC'=+'^(M) ://(M\5M)nVFy^0} 

is rectifiable of codimension codim W — dim M in the Banach space C^(M). This proves the 
present statement in the case of compact M. 

Ill order to end the proof of the theorem it remains to consider the non-compact case. Let 
M be a non-compact manifold (without boundary), and call A C C^~^^{M) the subset in the 
statement, namely 

^ = |/ g C''+'\M) : j^f{M) n / 0} . 

Let Kn CL M, n G N, be a sequence of smooth compact sets exhausting M. Each of them is 
a smooth manifold with boundary. Call P„: C^{M) — )• C^{Kn) the natural projection. Note 
that the space J^{Kn \ 9A'„,]R) is naturally included in j'^(M, R), and that A = U„A„ where 

= ( {/ G C'=+^(Kn,) : ff{Kn \ dKn) C^W ^ %]) . 

For each n the set 

{/ G C^-+^(K„,) : 3^f{Kn \ dKn) n / 0} 

is rectifiable of codimension codim — dimM in C^^^{Kn), because we are in the same 
situation of the set in (|2.3p . Moreover, each P„ is a surjective (cf. O [9l [5] for more general 
statements) continuous linear operator from the Frechet space C^{M) to the Banach space 
C^{Kn) and, a fortiori, it has dense range. Hence, by Definition [71 the set A is rectifiable of 
codimension codim W — dim M in the Frechet space C^{M), as desired. □ 

Clearly, the above theorem still holds true if one replaces W hy a. countable union of 
submanifolds of codimension greater or equal than dimM -|- 1. In fact it is still true when W 
is a rectifiable set of codimension greater or equal than dimM -t- 1, this also follows from [H 
Prop. 7]. 
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2.3. The Hamiltonian Flow-Box Theorem. 

Theorem 10. Let {N,uj) be a symplectic 2d- dimensional manifold, and H : N ^ be a 
function, k >2. Let z G N be such that d^H ^ 0. Then, there exist a C^^^ chart ip: U ^ 'M?'^ 
defined in a neighborhood U of z such that 

H o 'il)~^{x,p) = pi and ujq = uj 

where ojq is the standard symplectic form on M^'^ and {x,p) = {xi, . . . ,Xd,Pi, ■ ■ ■ ,Pd) are the 
associated Darboux coordinates. 

Proof. We refer to [U Theorem 5.2.19], where in fact the function H is assumed to be smooth. 
However, the diffeomorphism tp is therein constructed using the flow of H, which is C^~^ if H 
is C^. □ 



3. The autonomous case 

In this section we prove the main results presented in the introduction. For the convenience 
of the reader, we restate them as Theorem [11] and Theorem [12] below. 

Theorem 11 (Time-unoriented, autonomous case). Let N be a symplectic manifold of dimen- 
sion 2d, and let Hi G C*'^+^{N) satisfy the non- degeneracy assumption ([1]). Then, for every 
k > Ad, the set 

€ C'^iN) : On^H^iz) = iVVz € iv} 
has rectifiable complementary of codimension > 1 in C^{N). 

Theorem 12 (Time-oriented, autonomous case). Let N be a compact symplectic manifold of 
dimension 2d, and let Hi € C^'^~^'^{N) satisfy the non- degeneracy assumption ([1]). Then, for 
every k > Ad, the set 

[h2 G C^N) : = ^ Vz G iv} 

has rectifiable complementary of codimension > 1 in C'^(iV). 

The proof of both theorems makes use of the following two results. 

Lemma 13. Let N be a symplectic manifold, and let Hi be of class C'''^^ (k >2) and satisfy 
the non- degeneracy Assumption ([1]). Let us set 

No = {zeN : d,Hi =0}, N' = N\ Nq 
and define subsets W',Wo C J^~^{N,R) by 

M/'= |j G J^"^(iV,M) ■.ifj= j^~^H2 then z e N' and Ue\^'^{XH^, Xh^){z) C T^iv} 
Wo=\^j G J^~^(iV,M) ■.ifj= jl~^H2 then z e No and Xn^iz) G TNq^ 
We have: 

codim jfc-i(^£)Ty' = k — dimA^ + 1 
codim jfc-i(^]g)Wo > dim + 2. 

In particular, 

codim {W' U Wq) > dim + 1 as soon as k > 2dim A^. 



Recall that in Assumption [Tj we defined TNq as the union {Ji^jqTN'' where {A'''}; is a once-for-all fixed 
countable family of submanifolds of codimension greater or equal than codim A'o and whose union covers A'o. 
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Proposition 14. Let Hi,Nq,N' be as in Lemma [T3\ and H2 G C^{N), k >2, satisfy 

Xh,{z)^TNo VzGiVo. 

Then, the set 

{tGR:cj)'H,{z) £ No] 

has empty interior for every z G Nq . In particular, each z G Nq is accumulated by points in 
^Hi H2^^^ ^ ^' ^'^ ^^^^ ^'^ Poi'i^is in Ojj_^ H2^-^^ ^ ^' ' 

Proof of Theorem llll First of all, let us notice that it suffices to prove the result for k = 4d, 
thanks to Proposition [8j 

Let W' and Wq be as in Lemma[T3j By that Lemma and by the positive-codimension version 
of the Thom transversality theorem (Theorem [9|) we get that the set 

\^H2 G C^\N) : j^'^-^H2{N) n {W U Wo) = 0} 

has rectifiable complementary of codimension > 1 in C^'^{N). Thus it suffices to prove that 
any H2 belonging to the set above satisfies Ohi,H2{z) = N for all z G N. 

Let H2 belong to the set above. If the set No = {z G : dzHi = 0} is empty, then, recalling 
the definition of W, the conclusion follows from Theorems [2] and HI If Nq is not empty, the 
argument can be adapted as follows. 

By connectedness of N, it suffices to prove that the orbit of every point z G is open. By 
Remark [5l an orbit either is open or it has empty interior. Hence we are reduced to prove that 
the orbit of every point z G N has non-empty interior. This is true if z G iV' = \ A'^o, by 
definition of W and by the Rashevski-Chow Theorem. This is equally true if z G Nq, because 
in this case we get by Proposition [U that the orbit of z intersects (hence coincide with) the 
orbit of some point in A^', and we just proved that such an orbit has non-empty interior. 

□ 

Proof of Theorem 1121 The proof is analogous to the one of Theorem [11] above. As before, 
it suffices to prove the result for k = Ad. By repeating the first part of that proof, we get that 
the set 

(3.1) {^2 G C^'^{N) : f'^-^H2{N) n {W U Wq) = 0} 

has rectifiable complementary of codimension > 1 in C^'^{N). Hence it suffices to prove that 
any H2 belonging to the set above satisfies the properties stated in the theorem. 

Let H2 belong to the set above. If the set No = {z G A^ : d^Hi = 0} is empty, then the 
conclusion immediately follows from the time-oriented version of the Rashevski-Chow Theorem 
(see Theorems [2] and HD). Note that any fiow is complete on the compact manifold A^, and 
any Hamiltonian fiow on A^ has the property that all points are non-wandering by Poincare 
recurrence Theorem, thus the Theorem [Dj^ii) is indeed applicable. 

If A^o is not empty we adapt the argument as follows: by the Theorem Hl^ii) it suffices to 
prove that every z G A^ satisfies 

z G cl int O^^ (z) n cl int O^^ ^2 (-^)- 

This is true if z G A^' = A^ \ No by Krener's Theorem, see Thm. [2|^ii). This is equally true if 
z G A^o as we now show. Indeed, in this case we get by Proposition [TJ] that z is accumulated 
by a sequence (z„)„gN of points in O'jj^ H2^^^ ^ ^' ' Since each Zn belongs to A^', we know by 
the previous case that z„ is accumulated by a sequence {zn^k)k&i of points in iniO^^ ^^(z„). 
By definition of reachable set, we have int H2^^'^^ — '^"^^^tii H2^'^^ each n. Hence the 
subset {zn,k}n,k&N IS Contained in int (z) and has z as an accumulation point. This 

proves that z G clint H2^^^' '^^^ proof for 0~ is analogous. □ 

Proof of Lemma 1131 Let us first prove the inequality about W . If k < 2d then the condition 
Lie ^~^(X//^ , X/fj) $i TzN is trivially satisfied because Lie 5^~^(X//j , X/^j) is spanned by k 
vector fields, and the conclusion is true. Let us then suppose k > 2d. 
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The set W' is locally defined (above the open set N' C N) by the inequality 



(3.2) 



rank 



4 {Hi,{Hi,{...,{Hi,H2}...}}} 



\ 



< 2d. 



J 



k — 2 times 

By the Hamiltonian Flow-box Theorem (Thm. I10|) we can find, near any arbitrary point 
of N' , a local symplectic chart tp yielding identification with Darboux coordinates z = 
{x,p) = (xi, . . . ,Xii,pi, . . . ,pd) such that Hi{z) = pi0 A computation then shows that, in 
these coordinates, 

{Hi, {//i, {. . . , {Hi,H2} . . . }}}{z) = dx^H2iz), 

V ' 

m times 

for any function H2 differentiable enough. As a consequence, 



d, {Hi,{Hu{...,{HuH2}...}}} 



, dp^x-^H2 



m times 

and the definition ()3.2p for W' becomes more explicit: 

/ ... 1 

dxiH2 ... dx^H2 dp^H2 dp^H2 



rank 



\ 

dp.H2 



d 



d 



fz) < 2d. 



\d,.-.H2 . 

This is a k X 2d - matrix. The first row corresponds to dzHi. The other rows correspond 
to the iterated Lie brackets computed above up to m = /c — 2, and their entries are clearly 
independent when regarded as jet-coordinates. We deduce that the codimension of the set W' 
is the same as the codimension of the set of (A; — 1) x {2d — 1) matrices with non-maximal rank. 
Since we are assuming k > 2d, this codimension is well-known to be 

k-2d+l 

as desired. 

Let us now prove the inequality codim jfe-i(-^_ig-)Wo >2d + 2. By the Assumption [1] we have 

NoC\Jn' 

where each iV' is a submanifold of N of codimension greater or equal than d + 1. Each 
tangent space TN^ is a submanifold of TN and 

codimTArTiV' > 2{d + l). 

Since the map 

j''-^(iV,M) ^ TN 

jt'H2^XH,{z) 

is a submersion for all A; > 2 (due to non-degeneracy of the symplectic form), and Wq is 
precisely the preimage of TNq = Ui^j^TN'- via this map, we get 



codimjfe-iWo = codim^-ArTA^'o > 2{d + 1), 



as desired. 



□ 



'''Note that ip also induces a change of coordinates on j''~^{N, R), which is of class because tp is of class 
C'' . Hence the codimension of W' is the same as the codimension of its image under this diffeomorphism. This 
legitimates the subsequent computations (and accounts for the requirement Hi £ C'^^^ rather than just C*). 
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Proof of Proposition I14L Recall that A'^o is contained in a countable union of submanifolds 
{N''}i and, by definition, TNq = UiTNK We want to prove that for each z G Nq the set 

has empty interior. By Baire's Theorem, it suffices to prove that, for each fixed /, the closure 
of the set 

{teR:^'H^{z)eN'} 
has empty interior. This is easily seen to be true: the assumption 

Xh,{z)^T,N' yzeN' 

implies that the set above is constituted by isolated points, and the closure of such a set always 
has empty interior. □ 

4. The non-autonomous case 

In this section we extend to the time-dependent case the results obtained in the previous 
section. 

Let be a symplectic manifold of dimension 2d, and Hi,H2: N x M M two time- 
dependent Hamiltonians. They give rise to two time-dependent Hamiltonian vector fields on 
N denoted respectively by Xh-^ , ■ Equivalently, they give rise to two time-independent 
vector fields Xhi and Xh2 on x M defined by 

XH,{z,t) = iXH,iz,t),l) G r(,,i)(iVxM)^r,iVxM, {z,t) eN xM, ie {1,2}. 

We shall occasionally denote by M the manifold x M. If (z, t) G A^ x M, in this section its 
orbit Ohi,H2 i^i has to be intended as the orbit of {z, t) through Xh^ and Xh2 ■ It is therefore 
a subset of A^ x M. We adopt the analogous definition for the reachable set ^^{z,t). 

We will make the following assumption on Hi: 

Assumption 2. The Hamiltonian Hi is continuously dijferentiable and the subset Mq C A^xM 
defined by 

Mo = {{z,t) eN xR: d^Hi{z,t) = 0}, 

is contained in a countable union Ui^^M^ of C"^ -submanifolds of N xR of codimension greater 
or equal than ^iS^ + 1. Given such a family {M^}i we define the tangent space TMq as 

TMq = IJ tm'. 

Note that each TM^ is a submanifold of class in T{N x M). According to Definition\^ we 
have 

dim A^ 

codimATxKMo > — ^ h 1 

codim Q"(Af xM) 

TMq > 2 codim nxrMq > dimN + 2. 

As in the autonomous case, the above assumption is generic by an easy application of the 
classical Thom transversality Theorem. 

Let us now state the time-dependent versions of Theorems [11] and [T2l 

Theorem 15 (Time-unoriented, non-autonomous case). Let N be a symplectic manifold of 
dimension 2d, and let Hi € C^'^~^'^{N x M) satisfy the non- degeneracy assumption Then, 
for every k > 4:d+ 1 the set 



H2 G C''{N X R) : OHj,H2{z,t) =N xR V(z,t) G a} 
has rectifiable complementary of codimension > 1 in C^{N x R). 
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Since both vector fields Xhi and induce the equation t = 1 on the t-variable, it is 
obviously impossible for the reachable set of a point to be the whole of x R. For this reason 
we make the assumption that Hi and H2 are one-periodic in time, i.e. they are defined on 

X T where T = R/Z. We then regard the reachable set of a point {z, t) as a subset of x T. 

Theorem 16 (Time-oriented, periodic case). Let N be a compact symplectic manifold of 
dimension 2d, and let Hi € C^'^'^^{N x T) satisfy the non- degeneracy Assumption ([2]). For 
every k > 4:d+ 1 the set 

{^2 G C^{N X T) : Ojj^ H2^z,t) = A^ X T V e A^ x t} 
has rectifiable complementary of codimension > 1 in C^{N x T). 

Proof of Theorems 1151 and I16L The proof is the same as in the autonomous case (Theorems 
[TT] and [T2]l . once the time-dependent counterpart to Lemma [13] has been established. This is 
the content of Lemma [T7] below. Note that for the time-oriented part one has to apply at 
some point the Theorem 2] (ii) which makes the assumption that the two considered flows have 
non- wandering dynamics. Since Xh^ and Xh2 preserve the measure /u © on the compact 
manifold A^ x T, this assumption is indeed fulfilled by the Poincare Recurrence Theorem. □ 

Lemma 17. Let N he a symplectic manifold of dimension 2d, and let Hi : N x M. be of 
class C''^^ (k > 2) and satisfy the non- degeneracy assumption ([2]). Let us define the subsets 
Mo,M' CN xR by 



Mo = {{z,t) e A^ X R : d^,Hi{z,t) 
and the subsets W, Wq C J''~^{N x R,R) by 



0}, M' = (A^ X R) \ Mo 



W'-- 



{i G J'^-^N X 
'=-i(iV X 



Wo= {j G J 
We have: 



) : ^fj 
) : ^fj 

codim 



H2 then {z,t) e M' and Lie i~^(X//i , X//2)(^, t) C T(z,t){N x R)| 



j^~l^H2 then {z,t) G Mo and Xn^iz) £ TMoj 



■^W' = k-dimN 
L(7VxR,R)^o > dim(Ar X R) + L 
In particular, codim (W' U Wo) ^ dim A^ -\- 1 as soon as k > 2dim A^ -|- 1. 



L jfe-i(7VxR,I 

codim jk-ii 



Remark 18. The lemma above is stated in the non-periodic setting. It holds in the periodic 
case as well by replacing the jet space j''~^{N x R, R) with j'^^^^N x T, R). The proof remains 
essentially unchanged. 

Proof of Lemma 1171 The proof is very similar to the one of Lemma [THl We start with 
proving the inequality about W, for which we only consider the case k > 2d -\- 1. In the other 
cases the result is trivial by a dimensional argument. 

Let jo be an arbitrary element of W. We are going to prove that in a neighborhood of jo 
the codimension of W is bounded below by the desired value k — diniA^. The global bound 
on the codimension of W will then follow by standard arguments. The subset W is defined 
by the inequality 



(4.1) 



rank 



Xhi 

[Xhi,Xh2] 

. . , [Xhj,Xh2] ■■■]] 



2 times 



{z,t) <2d + l 



J 
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which depends just on the {k — l)-jet of H2. Note that, since Hi is of class C^^'^ and the 
matrix involves up to A; — 1 derivatives of Hi, its entries are of class in the variable j = 
4T*)^2€ J^-HiVxR,R). 

Let us denote {zQ^to) the source of the jet jq. Since jo € W\ we have dzHi{zo,tQ) ^ 0. 
By the Hamiltonian Flowbox Theorem (Thm. [T0|) applied at Hi{-,to), there exists a local 
diffeomorphism ^ xid yielding identification with coordinates {z, t) = {x,p, t) onU x m]^ with 
(x,p) = (xi, . . . ,x^,pi, . . . ,pj) being standard Darboux variables on the open set U C M^'^, 
and such that the Hamiltonian in the new coordinates satisfies at time to 

Hi{z,to)=Pi yzeU. 

Using these coordinates it is easy to compute the restriction at t = to of the iterated Lie 
brackets with Xhi- Indeed, for any m > 1 and any function H2{z, t) differentiable enough, the 
computation (which we omit) yields 

[XH„[-y,[XH, , Xh,] . . . ]]{z, to) = {Xk^ (z, to), O) V z = {x,p) € U 

m times 

where Xk^. is the Hamiltonian vector field on U associated to the function Km : C/ — )■ M defined 
by 

z ^ Kmiz) = (9,, - dtrH2{z,to) + {d,, - dtr-'dtHi{z,to). 
Note that Km is a sum of two terms, with H2 appearing just in the first summand and Hi 
just in the second. 

Let us denote j = {z, t,j') the elements of J^~^{U x M, R), where the variable j' regroups all 
variables other than the source {z,t), i.e. / regroups the value of H2 as well as all its partial 
derivatives up to order k — 1. By using the explicit computation above we get that in the new 
coordinates the inequality (|4.ip defining W' becomes 

rank (^A{j') + BhAz, to) + CHAz^tJ')) < 2d + 1 

where: 

• the matrix CHi{z,t, j') is a matrix which is identically zero for t = to and its exact 
expression does not play any role here; 

• the matrix A{j') is given bjo 



A{f) = 



/I 


dp^H2 




t)H2 


5pi%i-t)'=-2-f^2 \ 





dp^H2 


'^P2^{xi- 


t)H2 


dp2d{xi~t)''~'^H2 





dp,H2 


dpA^i- 


t)H2 


'5pd%i-i)''-2-^2 





-dx,H2 


-dxid(xi 


-t)H2 ■ ■ 


• -9xid(^xi-t)k-^H2 





-d.,H2 


-9xad{xi 


-t)H2 ■ ■ 


■ -9xad(^xi-t)t'-^H2 


V 


1 







/ 



(here the first two columns correspond to X^i and X/^j, and the remaining columns 
account for the ff2-summand in the definition of Km., for m ranging from 1 to A; — 2); 
• the matrix Bn^iz^to), depending just on z but not on t and j', accounts for the 
i^i-summand in the definition of Km and its exact expression does not play any role. 
Prom the expressions above it is clear that for t = to the variable j' appears just in the matrix 
A. Let us denote by J^~\^) the fiber of j'=~i(C/ X R, R) over (^0,^0)- From the expression 

of A(j') above we deduce that the codimension of W D n in J/'^~l n is the same as the 

^Note that x \d also induces a local diflteomorphism of class from (a subset of) J''~^{N x R, R) to 
J*-i([/ X R,R), thus preserving codimensions of subsets. 

^For reasons of page layout, the matrix A{j') written here is rather the transpose of what it should be in 
according to the matrix in (|4.ip . 
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codimension of the set of 2d x (A: — 1) matrices with non-maximal rank. Since we are assuming 
k > 2d + 1, this codimension is well-known to be 

k - 2d. 

Since B^i and Chi are of class C^, this fiberwise estimate allows to deduce the local bound 

codim jfc-i((7xR,R)l^' > k — 2d in a neighborhood of jo, 

which is what we wanted to prove. 

Let us now prove the inequality about Wq. The set Wq is the preimage of TMq under the 
map 

j'^-^iN X M, M) ^ T{N xR) ^TN xRxR 

Let us write TMq = VJi^^TM^ with each being a submanifold. It is not difficult to 
check that the map above is transverse to the submanifold TM' for each I. Recalling the 
Assumption [2] on Hi , we then deduce 

codim jfe-i(^xR,R)^^o = codim r( AT xR) |J TM^ >2d + 2. □ 
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